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INTRODUCTION 


I. 


Improvements  in  robust  performance  of  a  Turret-Gun  System  mounted  on 
helicopters,  can  significantly  enhance  the  mission  capabilities  of  light  attack 
helicopters.  Designing  controllers  for  a  Turret-Gun  System,  whose 
mathematical  model  is  subject  to  uncertainties  is  an  interesting  and  challenging 
problem.  The  uncertainties  in  the  model  may  arise  from  unmodeled  dynamics, 
paremeter  variations,  linearization  of  nonlinear  elements,  sensor  noises  etc.  A 
control  strategy  which  can  guarantee  stability  and  provide  satisfactory 
performance  in  the  presence  of  model  uncertainties,  is  called  a  robust 
controller.  Among  the  various  design  methods  for  robust  controllers,  the  linear 
quadratic  Gaussian  with  loop  transfer  recovery  (LQG/LTR)  design  procedure 
[1]  has  many  advantages.  This  methodology  will  result  in  control  systems  with 
excellent  stability  robustness,  command  following,  disturbance  rejection  and 
sensor  noise  suppression  properties. 

A  frequency-shaped  linear  quadratic  regulator  (FSLQR)  methodology  [2] 
based  on  the  frequency  domain  penalties  to  the  state  variables  and  inputs  in 
the  cost  functional  has  received  considerable  attention  in  the  literature  [3-6], 

The  LQG/LTR  and  FSLQR  design  methodologies  have  been  employed 
to  design  robust  controllers  for  a  Turret  Gun  System. 

One  of  the  important  problems  in  the  control  of  a  Turret-Gun  system  is  to 
approximate  a  high-order,  complex  mathematical  model  of  the  system  with  a 
low-order,  simpler  model.  The  resulting  reduced  order  models  are  useful  for 
designing  and  implementing  robust  controllers  for  a  Turret-Gun  System.  This 
methodology  will  provide  simplicity  of  implementation  and  reduction  in 
hardware  requirements. 

The  Turret-Gun  System  contains  nonlinear  elements,  such  as  gear 
trains,  servo  valves,  hydraulic  motors  etc.  In  this  system,  the  firing 
disturbances  excite  the  structural  modes.  Integrated  Systems  Inc.  (IS!)  has 
developed  a  detailed  nonlinear  model  and  identified  various  parameters  of  the 
model  [7].  A  linear  quadratic  Gaussian  with  loop  transfer  recovery  (LQG/LTR) 
controller  is  designed  for  the  gun  system  using  linearized  models.  We 
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encountered  the  convergence/numerical  integration  problems  in  the  simulation 
of  this  controller  along  with  the  non-linear  plant.  It  is  also  noticed  that  there  is  a 
large  spread  of  eigenvalues  of  the  linear  model  [8].  For  the  convergence  of  the 
control  algorithms  and  their  easy  implementation,  controllers  are  designed 
using  reduced  order  models. 

A  large  number  of  techniques  are  available  in  the  literature  for  deriving 
reduced  order  models.  In  this  report  reduced  order  models  for  Turret-Gun 
Systems  are  designed  using  balanced  realization  [9],  Litz's  modal  technique 
[10]  and  Routh  Approximation  [1 1,12]  methods.  A  critical  comparison  of  time 
and  frequency  response  characteristics  between  an  original  and  reduced 
order  models  is  made.  The  choice  of  a  reduced  order  model  is  very  significant 
for  the  validity  of  reduced  order  robust  controllers.  The  linear  quadratic 
Gaussian  with  loop  transfer  recovery  methodology  is  employed  to  design 
reduced  order  robust  controllers.  The  discarded  modes  in  the  original  system 
representation  can  be  excited  by  a  reduced  order  controller  and  may 
destabilize  the  control  system.  This  problem  is  known  as  spillover  problem  and 
is  eliminated  in  the  proposed  design  methodology. 

II  RESEARCH  -OBJECTIVES 

The  research  objectives  are 

(1 )  Design  an  LQG/LTR  controller  for  a  Turret-Gun  System  which  has  good 
command  following  for  step,  ramp  and  acceleration  inputs. 

(2)  Design  a  frequency  shaped  linear  quadratic  regulator  (FSLQR)  for 
minimizing  high  frequency  uncertainties. 

(3)  Design  of  LQG/LTR  and  FSLQR  controllers  using  reduced  order  models. 

(4)  Stability  and  performance  in  the  presence  of  uncertainties. 

(5)  Simulation  studies  incorporating  reduced  order  controller  with  a 
nonlinear  plant. 


2 


Ill  DESCRIPTION  OF  THE  TURRET-GUN  SYSTEM 


The  Turret-Gun  System  consists  of  a  30  mm  chain  gun  driven  by  an 
electrical  motor  and  is  capable  of  firing  600  rounds  per  minute.  Weapon 
pointing  commands  are  generated  by  an  integrated  helmet  and  display  sight 
system  using  a  fire  control  computer. 

The  gun  is  mounted  within  a  cradle  using  a  brass  slide  mechanism  which 
allows  for  recoil  movement.  Recoil  adapters  are  mounted  between  the  recoiling 
mass  of  the  gun  and  the  cradle  to  absorb  some  of  the  recoil  force.  The  cradle 
and  gun  assemblies  are  attached  to  a  fork  using  two  trunnion  pins.  One 
trunnion  pin  has  a  resolver  built  into  it.  This  resolver  provides  the  elevation 
pointing  error  to  the  turret  control  box.  The  elevation  axis  positioning  is 
accomplished  through  the  use  of  a  servo  valve  controlled,  double  acting 
hydraulic  cylinder.  The  piston  has  unequal  cross-sectional  areas  to  account 
for  gravitational  effects.  A  delta  hydraulic  pressure  transducer  provides  rate 
feedback  information  to  the  turret  control  box. 

The  fork  assembly  is  held  in  place  by  the  Azimuth  housing.  The  housing 
holds  a  rotary  hydraulic  motor  and  a  gearbox.  The  housing  also  holds  a  train 
rate  sensor  which  measures  the  angular  velocity  of  the  Gun/Cradle/Fork  unit, 
and  a  resolver  for  measuring  the  angular  position. The  Azimuth  housing,  fork, 
cradle  and  gun  are  attached  to  the  vehicle’s  hull. 

IV  REDUCED  -  ORDER  MODELING  TECHNIQUES 

In  this  Section  a  brief  review  of  various  reduced  order  modeling 
techniques  is  given. 

(A)  Balanced  Realization  Method: 

Among  the  various  model  reduction  techniques,  reduced  order  models 
derived  using  the  balancing-truncation  [9]  technique  have  many  advantages. 
This  technique  is  based  on  controllability  and  observability  (location  of 
actuators  and  sensors)  considerations  of  the  plant.  The  subsystem 
corresponding  to  dominant  (non-dominant)  singular  values  of  the  balanced 
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Grammians  is  termed  the  strong  (weak)  subsystem.  By  approximating  the  weak 
subsystem  at  oo  =  0,  a  reduced  order  model  is  derived.  Let  the  state  variable 
representation  of  a  Turret-Gun  System  be  given  by 


x  =  Ax  +  Bu  ...(1) 

y  =  Cx  +  Du  ...(2) 

Let  xb  =  Tx 

where  T  is  a  linear  transformation  matrix  which  transforms  the  system 
^presentation  into  balance  realization  form. 

xb  "  ^balxb  +  ®balu  •••(4) 

y  =Cbalxb  +  Dbalu  ...(5) 

The  Hankel  singular  values  (aj)  are  determined  by 

CTj  =  ^j(PQ)  i  =  l  2,  ...  n  ...(6) 

where  P  and  Q  are  controllability  and  observability  grammians. 

The  balanced  realization  Eqns  (4  and  5)  are  partitioned  as 

x1=A11x1  +  A<  iX2  +  B-|U  ...(7) 

X2  ~  A21xi  +  A22X2  +  B2U  ...(8) 

y  =  C1x1  +  C2x2  +  Du  ...(9) 

The  approximation  employed  is 

X2(s)  =  -A2^A21X1(s)- A2^B2U(s)  ...(10) 

and  the  reduced  order  model  is  given  by 
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where 


xr  =  Arxr  +  Bru 
yr  =  Crxr  +  DrU 


...(11) 

...(12) 


Ar  ~  Al 1 -  A12A22A21  •••03) 

Br  =  B.,-  A12A22B2  ...(14) 

Cr  =  Ci-C2A22A21  ...(15) 

Dr  =  D.,-C2A22B2  ...(16) 


The  reduced  order  models  possess  the  following  properties  [13]  which 
are  very  useful  in  the  design  of  reduced  order  LQG/LTR  controllers. 

(i)  The  reduced  order  models  preserve  stability,  controllability, 
observability  and  minimality. 

(ii)  The  steady  state  values  of  the  original  system  and  reduced  order  model 
are  identical. 

(iii)  Error  bound  of  the  reduced  order  model 

n 

d [G(jto) - Gr(ja))]  <  2  v  o)  ...(17) 

i=r+1 

(iv)  Reduced  order  models  have  goof  frequency  response  match  at  low 
frequencies. 

(B)  Routh  Approximation  Method 

The  Routh  Approximation  method  proposed  by  Hutton  and  Friedland 
[1 1],  is  based  on  the  Routh  Stability  criterion.  This  reduced  order  methodology 
has  the  following  properties. 

(i)  The  reduced  order  model  is  guaranteed  stable,  if  the  original  system  is 
stable. 

(ii)  The  sequence  of  Routh  approximants  converge  monotonically  to  the 
original  system  in  terms  of  the  impulse  response  energy. 

(iii)  The  method  does  not  require  any  information  about  the  system 
eigenvalues  and  eigenvectors. 
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Rao,  et  al  [12]  have  developed  a  Routh  canonical  realization  in  time 
domain  for  single  input  -  single  output  systems.  This  procedure  eliminates  the 
reciprocal  transformations  used  in  the  Hutton  and  Friedland  [11]  procedure. 

Consider  a  linear  system  represented  in  the  phase  canonical  form 

x  =  Ax  +  Bu  •■■(18] 

y  =  Cx  ...(19) 

where  x  is  an  n-vector,  u  and  y  are  scalar. 

The  Routh  canoncial  form  is  obtained  by  considering  a  linear 
transformation 


z  =  Px  ...(20) 


and  is  given  by 


z  =  Fz  +  Gu 

...(21) 

N 

LU 

II 

>, 

•  ••(22) 

where  F  =  PAP 

!  G  = 

PB, 

E  =  CP 

-1 

...(23) 

The  system  matrices 

F  and  G 

5  can 

i  be  written  as 

'-Yl 

0 

-y3 

0 

-Ys 

-  "Yn‘ 

0 

0 

y3 

0 

Ys 

-  Yn 

F  = 

-Yi 

-Y2 

-y3 

0 

-Ys 

-  "Yn 

_“Yl 

-Y  2 

-y3  - 

-y4 

-y5 

-  -Ynj 

G  = 

[1  0 

1  0 

1  ... 

1T 

for  n  odd 

...(24) 
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- 1 

0 

ro 

0 

y4 

Yn 

1 

__ L 

1 

ro 

0 

-y4 

•••  ~Yn 

0  0 

0 

y4 

Yn 

1 - 

1 

• 

1 

ro 

-Y3 

-y4 

-  "Yn. 

[0101 

. . . 

1]T 

for  n  even 

(25) 


where  the  values  of  71  are  obtained  from  a  Routh  table  using  the  characteristic 
equation  of  the  transfer  function  C(sl-A)-1B. 


Let  the  characteristic  equation  be 


f(s)  =  sn  +  a1sn  1  +  a2sn  2+...an  =  0 


.(26) 


Then  the  Routh  table  can  be  constructed  as 


an  an-2  an-4 
an-1  an-3  an-5 


a2  1 
a1  0 


The  yi  are  given  by 


•  (27) 


an 

an-1 


Y2  = 


_  an-1 


a2 
_  a0 


,n-l 


v  —  _ Si  V  —  — -y- _ 

^2 -  3  •••  Yn-  _n 


The  transformation  matrix  P  can  be  extracted  from  the  Routh  table  as 
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an-1  0  an-3  0  •"  1 

0  a§  0  ...  0 

0  0  a§  0  1 

0  0  0  0  ...  1 

For  an  even  order  n,  the  last  column  of  P  is  replaced  by 

[0  1  0  1  ...  0  1]T 

The  output  matrix  E  can  be  evaluated  using  the  relationship 

E  =  CP-1  ...(29) 

A  reduced  order  model  is  derived  by  discarding  zr+i, .  .  .  zn  and  is  given  by 

xr  =  Arxr  +  Bru  ...(30) 

yr  =  Crxr  ...(31) 

where 

Ar  =  DFDT,  Br  =  DG,  Cr  =  EDT 
and  D  =  ['r  :  °Ln 

(C)  Litz's  Modal  Method 

The  reduced  order  models  derived  on  the  basis  of  modal  techniques 
play  a  very  important  role  in  the  design  of  controllers  for  large  scale  systems.  A 
large  number  of  modal  techniques  are  available  in  the  literature  [14].  Litz  [10] 
has  developed  a  reduced  order  model  based  on  a  dominance  measure  and 
permits  larger  reductions  in  size  for  the  same  accuracy.  A  brief  review  of  this 
method  is  given  below: 
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Consider  a  linear  system  represented  by 


...(32) 

...(33) 


x  =  Ax  +  Bu 
Let  x  =  Pz 

where  P  is  a  transformation  matrix  which  transforms  the  given  system  into 
Jordan  canonical  form 

z  =  Az  +  Gu  ...(34) 

A  dominance  measure  is  introduced  by  Litz,  to  determine  dominant  modes  to  be 
retained,  most  sensitive  state  variables  and  an  appropriate  order  for  the 
reduced  model.  Equations  (33)  and  (34)  are  partitioned  as  shown  below: 


X 

>11 

Pi  2 

X 

_X2. 

P21 

P22. 

_Z2_ 

...(35) 


X 

0  ‘ 

X 

+ 

"X 

0 

A2 

C\J 
N 
_ l 

_G2_ 

...(36) 


where  zi  and  zz  represent  dominant  and  nondominant  states  respectively. 

To  derive  a  reduced  order  model,  the  following  approximation  is 
introduced: 


z2  =  Ezi  ...(37) 

From  Equations  (35,36  and  37) 

xi  =  (^i  1  +  ^12  ^)zi  =  ••■(38) 

z.,=  A-^  +  G-jU 

Let  xr  =  Fz1  •••(39) 

where  F  =  (P-n  +P12E)  is  a  linear  transformation  matrix. 
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The  reduced  order  model  is  given  by 


...(40) 

-(41) 


xr  =  Arxr  +  Bru 

whereAr  =  FA.|F-1  and  Br  =  FG1 

The  matrix  E  is  determined  optimally  through  the  use  of  Lagrange  multipliers  to 
minimize  a  weighted  integral  of  the  square  of  the  error  between  z2  and  Z2.  The 
matrix  E  is  given  by 

e  =  a-1[s+(g2-st-1g1)(g;t-1g1)-1g;]t-1a1  ...(42) 

where 


V  STATE  VARIABLE  MODEL  OF  THE  TURRET-GUN  SYSTEM 

A  model  of  the  turret-gun  system  which  relates  inputs  and  outputs  is 
needed  for  control  design  purposes.  A  detailed  nonlinear  model  of  the  system 
was  developed  by  Integrated  Systems  Inc.  [7],  A  separate  model  for  azimuth 
and  elevation  axis  were  developed  as  the  coupling  between  them  is  minimal. 
The  azimuth  axis  system  (Fig  1)  consists  of  three  physically  identifiable 
sections:  (1)  servovalue  (2)  hydraulic  motor/gearbox  and  (3)  gun  plant.  A 
block  diagram  represenations  of  this  is  shown  in  Fig  2.  A  linear  state  variable 
model  of  the  azimuth  axis  system  is  obtained  by  using  system  build  and 
analyzing  system  features  of  Matrix  x.  The  state  variable  model  derived  at  the 
nominal  operating  point  (t  =  0.04)  has  13  eigenvalues  values  and  the  damping 
factors,  natural  frequencies  of  this  system  are  given  in  Table  I.  The  input  and 
output  variables  are  azimuth  current  and  train  rate  respectively.  The  mode  at 
-19.385  is  not  controllable  with  the  selected  input,  hence  a  minimal  realization 
of  the  system  is  derived  by  neglecting  this  mode.  The  order  of  the  model  is  12 
and  it  is  noticed  that  there  is  a  large  spread  in  the  eigenvalues  of  this  model. 
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Diagram  of  Azimuth  Axis  System. 
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Continuous  Supar-Block 
Axiauth  Motor 


Ext.  Inputs 


Ext .Outputs 


Fig  2.  Block  Diagram  Representation  ofAzimuth  Axis  System. 


table  -  I 

Eigenvalues,  Damping  Ratio  and  Natural  Frequencies  of  Azimuth  Axis  System 


Eigenvalues 

Damping  Ratio 

Natural  Frequencies 

-1.713  x  10’3 

-5.375  ±  j52.045 

0.10273 

52.322  (rad/sec) 

-20.265  ±j1 37.94 

0.14535 

139.42  (rad/sec) 

-19.819  ±j294.8 

0.06707 

295.47  (rad/sec) 

-945.26 

-1573.2  ±j4550. 7 

0.32673 

4815.0  (rad/sec) 

-122.23  ±j6397.9 

0.01910 

6399.1  (rad/sec) 
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VI. 


A  12th  order  linear  state  variable  model  of  the  Turret-Gun  System  is 
derived  from  a  nonlinear  system  by  using  analyzing  systems  features  of 
matrix  x.  The  input  and  output  variables  are  azimuth  current  and  train  rate 
respectively.  A  7th  order  reduced  model  is  selected  on  the  basis  of 
eigenvalues  and  singular  values.  The  reduced  order  models  are  derived  by 
using  balance-truncation,  Litz’s  modal  technique  and  Routh  approximation 
methods.  The  eigenvalues  of  the  original  system  and  reduced  order  models 
are  given  in  Table  II.  The  frequency  response  plots  of  original  and  reduced 
order  models  are  given  in  Fig  (3).  There  is  an  excellent  low  frequency  match 
between  original  and  reduced  order  models.  Step  response  comparisons  were 
made  between  original  and  reduced  order  models  and  are  given  in  Fig  (4).  It  is 
very  hard  to  see  the  difference  between  original  and  reduced  order  models. 
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Table  -II  Comparison  of  Eigenvalues 
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VII 


In  recent  years,  an  increased  amount  of  research  has  been  directed 
toward  the  design  of  controllers  for  the  systems  whose  nominal  model  is  subject 
to  uncertainties.  In  general  the  uncertainties  in  the  model  arise  due  to  the 
following  causes: 

(1)  High  frequency  dynamics  and  other  characteristics  of  the  plant  that  are 
unknown  or  not  well  understood.  These  unmodelled  characteristics  of 
the  plant  also  include  modes  that  are  ignored  when  using  reduced  order 
models  to  simplify  the  controller  or  the  computations  involveds  in  design. 

(2)  Variations  in  the  plant  behavior  due  to  changes  in  operating  conditions. 
This  type  of  uncertainty  is  probably  best  understood  and  typically 
occurs  in  aircraft  and  other  applications  where  the  altitude,  pressure, 
temperature  and  flight  speed  all  affect  the  dynamics  of  the  system. 

(3)  Errors  due  to  inaccurate  or  incorrectly  calibrated  sensors  and  actuators, 
and  noise  introduced  by  these  devices.  These  uncertainties  are 
generally  modelled  using  frequency  domain  techniques  and  involve  a 
stochastic  process. 

The  characterization  of  the  model  uncertainties  play  an  important  role  in 
the  design  of  LQG/LTR  controllers.  Hence  a  brief  review  of  frequency  and  time 
domain  uncertainties  is  given  below: 

(A)  Frequency  Domain  Uncertainties.  In  the  frequency  domain,  model 
uncertainties  are  most  often  represented  by  a  transfer  function  matrix,  which 
either  multiplies  ar  adds  to  the  transfer  function  matrix  of  the  nominal  plant 
model.  These  uncertainties  may  be  assumed  to  occur  either  at  the  input  to  the 
plant,  or  at  the  output  of  the  plant.  Figure  5  shows  block  diagrams  of  various 
frequency  domain  uncertainty  representations.  Generally  the  mathematical 
model  is  fairly  accurate  at  low  frequencies,  so  the  uncertainties  are  small.  High 
frequency  behavior  of  real  systems  is  not  understood  and  many  times  not 
modeled,  so  that  L(s)  becomes  large  for  high  frequencies. 
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G(s)  =  G(s)[l+Lm(s)] 


G(s)  =  [i+Lm(s)]G(s) 


Frequency  Domain  Representations  of  Model  Uncertainty, 
a)  Additive  Uncertainty,  b)  Input  Multiplicative  Uncertainty 
c)  Output  Multiplicative  Uncertainty. 


When  discussing  the  size  of  a  matrix,  singular  values  play  an  important  role. 
This  concept  provides  a  way  to  quantify  the  size  of  a  matrix  and  is  defined  by 


o(A)  =  -^A.(AHA)  where 

g( A)  denotes  the  singular  values  of  A, 

1(M)  denotes  the  eigenvalues  of  M, 

AH  is  the  complex  conjugate  transpose  of  A, 
o(A)  is  the  maximum  singular  value  of  A,  and 
a(A)  is  the  minimum  singular  value  of  A. 

It  is  usually  convenient  to  define  a  bound  on  the  uncertainties  in  terms  of  the 
maximum  singular  values. 


1a(co)  >  o[La(s)] 

1m(w)  >  c[l_m(s)] 

A  typical  1m(co)  plot  is  shown  in  figure  6. 
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Fig  6  Bound  on  Frequency  Domain  Multiplicative  Uncertainty. 
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(B)  Time  Domain  Uncertainties.  For  time  domain  analysis  a  state  variable 
model  is  most  often  used  for  the  nominal  plant.  Uncertainties  are  therefore 
represented  as  changes  in  the  matrices  of  the  state  variable  model.  In  most 
cases,  an  additive  representation  is  used  where  an  uncertain  matrix  of 
appropriate  dimension  is  added  to  the  associated  nominal  model  matrix.  The 
linear  state  variable  model  is  given  by 

x  =  Ax  +  Bu  ...(45) 

y  =  Cx  +  Du  ...(46) 

where  x  is  the  state  vector  of  dimension  n,  u  is  the  input  vector  with  dimension 
m  and  y  is  the  output  vector  with  dimension  p.  For  our  purposes  the 
uncertainties  are  assumed  to  be  additive  so  the  general  perturbed  system  is 

x  =  (A  +  AA)x  +  (B  + AB)u  ...(47) 

y  =  (C  + AC)x +  (D  + AD)u  ...(48) 

(C)  Robustness 

A  system  is  said  to  be  robust,  with  respect  to  a  given  class  of 
uncertainties,  if  for  any  of  those  variations  in  the  plant,  the  overall  system 
behavior  remains  acceptable.  Therefore  the  designer  should  be  aware  of  all 
the  variations  that  can  be  expected  to  occur  in  the  real  system  and  be  able  to 
describe  them  so  as  to  insure  acceptable  behavior  in  the  real  system  for  all 
conditions.  The  previous  two  sections  introduced  two  general  methods  for 
describing  plant  variations  or  model  uncertainties.  The  way  in  which 
acceptable  behavior  is  defined  yields  two  types  of  robustness. 

Stability  robustness  implies  that  the  system  remains  stable  under  the 
given  perturbations,  while  performance  robustness  implies  that  the 
performance  of  the  system  does  not  deteriorate  below  acceptable  bounds 
under  the  given  class  of  perturbations. 

(D)  Properties  of  a  Feedback  System 

The  important  properties  of  a  feedback  system  are  given  below: 
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D  Properties  of  a  Feedback  System 


The  important  properties  of  a  feedback  system  are  given  below: 
Consider  the  feedback  system  shown  in  Fig.  7. 


The  output  of  the  closed  loop  system  is  given  by 

Y(s)  =  [I  +  G(s)K(s)]_1G(s)K(s)[R(s)  -  r\{s)]  +  [l  +  G(s)K(s)]_1d(s)  . .  .(49) 

1 .  Command  Following.  The  output  y  must  track  the  reference  input  r 
so  that  the  transfer  function  between  y  and  r  should  be  approximately  equal  to 
the  identity  matrix. 

Y  (s)  =  [l  +  G(s)K(s)]-1G(s)K(s)  R(s)  ...(50) 

If  G(s)K(s)  is  large,  that  is  if  £[[G(s)K(s)]»1  ,  then 

Y(s)  =  [G(s)K(s)]_1G(s)K(s)R(s)  =  R(s)  ...(51) 

therefore  y  =  r  which  is  the  desired  command  following  characteristic. 

2.  Disturbance  Rejection.  The  output  y  should  be  rather  insensitive 
to  disturbances  d.  Consequently  the  transfer  function  between  Y(s)  and  D(s) 
should  be  small. 
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Y(s)  =  [l  +  G(s)K(s)]  1  D(s) 


...(52) 


if  s[G(s)K(s)]»1 ,  then  Y(s)  =  [G(s)K(s)]_1D(s)  which  means  y  is  insensitive  to 
disturbances  when  G(s)K(s)  is  large. 

3.  Sensor  Noise  Rejection,  Likewise  the  transfer  function  between 
the  output  y  and  the  sensor  noise  r\  should  be  small  so  that  the  noise  attributed 
to  the  sensors  has  minimal  effect  on  the  output. 

Y(s)  =  [I  +  G(s)K(s)]-1G(s)K(s)r|(s)  ...(53) 

When  G(s)K(s)  is  small,  Y(s)  a  G(s)K(s)r|(s),  so  that  the  noise  rejection  is 
achieved.  In  this  case,  small  G(s)K(s)  is  defined  as  a[G(s)K(s)] « 1. 

4.  Performance  Robustness.  If  there  are  variations  in  the  plant  then 
the  control  should  be  such  that  the  effect  on  the  output  is  minimal.  Let  the  plant 
be  represented  by  Gn(s)  +AG(s)  where  Gn  represents  the  nominal  plant  model 
used  in  design  and  AG  represents  uncertainties  or  variations  occuring  in  the 
real  plant.  Then  the  output  will  have  a  component  due  to  the  nominal  system 
and  a  component  due  to  the  perturbations.  This  can  be  represented  by 

Y  +  AY  =  [I  +  Gn  K  +  AGK]-1[Gn  K  +  AK][r  -  r|]  +  [I  +  Gn  K  +  AGK]-1  d  ...(54) 

where  the  dependence  on  s  is  not  explicitly  shown  to  simplify  notation.  The 
change  in  the  output  due  to  the  system  perturbations  is  given  by 

AY  =  j[l  +  Gn  K  +  AGK]_1[Gn  K  +  AGK]  -  [I  +  Gn  K]-1Gn  K}(r  -  r|) 

+  {[I  +  Gn  K  +  AGK]'1  -  [I  +  Gn  K]'1}  d  . .  .(55) 

To  minimize  performance  changes  due  to  AG(s),  AY  should  be  as  small  as 
possible.  If  G(s)K(s)  is  large,  that  is  if  s{G(s)K(s)]»1  the  transfer  function 
becomes 
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...(56) 


AY  =  {[Gn  K  +  AGK]_1[Gn  K  +  AGK]  -  [Gn  K]_1Gn  K}(r  -  r\) 

+|[Gn K  +  AGK]-1  -  [Gn  K]-1j  d 
=  0(r  —  "n)  +  |[Gn  K  +  AGK]-1  -  [Gn  K]-1J  d 

Therefore  AY  due  to  AG(s)  is  small  when  s[G(s)K(s)]»1 . 


Summarizing  the  above  four  properties,  the  gains  G(s)K(s)  should  be 
large  for  command  following,  disturbance  rejection,  and  performance 
robustness,  but  should  be  small  for  sensor  noise  rejection.  This  is  not  as 
contradictory  as  it  may  sound,  since  noise  is  usually  a  high  frequency 
phenomenon,  while  commands,  disturbances,  and  parameter  variations  are 
much  slower  or  even  constant  and  thus  occur  only  at  low  frequencies. 
Therefore  for  good  performance  the  loop  gains  should  be  large  at  low 
frequencies  and  small  at  high  frequencies.  Also  for  MIMO  systems  it  is 

generally  beneficial  to  have  o[G(s)K(s)]  =  q[G(s)K(s)]  so  that  the  performance 
is  similar  in  all  loops.  These  properties  describe  desirable  feedback  system 
characteristics  in  the  frequency  domain.  However  there  is  another 
consideration  that  puts  not  just  desirable,  but  necessary  constraints  on  the 
system  transfer  function. 


5.  Stability  Robustness.  Consider  unstructured  multiplicative 
uncertainties  at  the  output  of  the  plant  G(s)  =  [l  +  L(s)]G(s),  where  G(s) 
represents  the  actual  plant  and  G(s)  represents  the  nominal  plant  model.  The 
system  must  remain  stable  for  all  possible  L(s).  Using  the  multivariable  Nyquist 
criteria,  this  requires 


a 


(i+gkc'gk1 


1" 


1m(w) 


...(57) 


where  1m(w)>oL(jco)  [1],  When  s[G(s)K(s)]»1 ,  a[(l+GK)'1GK]=1  so  that  for 
1  m(co)<1 ,  the  loop  gains  G(s)K(s)  can  be  large.  When  1  m(co)>1 ,  G(s)K(s)  must 

become  small,  and  when  1  m(o>)»1 ,  cG(s)< — ]—  so  that  c(GK)  must 

1m(co) 
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decrease  rapidly.  Thus  the  crossover  frequency  of  1m(cD)  limits  the  bandwidth 
of  the  system  by  limiting  the  crossover  frequency  of  o(GK).  This  restriction  is 
not  just  desirable  but  necessary  for  stability  due  to  the  fact  that  for  some  L(s) 

where  aL(jco)>1m(co)  the  system  will  be  unstable  if  c[(l  +  GK)-1GK]  =  — 

W03) 

There  is  some  degree  of  conservatism  associated  with  this  due  to  the 
unstructured  assumptions  inherent  in  singular  value  analysis.  There  may  be 
some  L(s)  where  aL(jco)>1m(ot))  but  the  system  remains  stable  even  with 

a[(l  +  GKj-XSK]  =  — .  However  without  specific  knowledge  of  the  actual 
L  1  ImM 

L(s),  g[(I  +  GK)~1GK]  must  be  less  than  1m(cD)  for  all  coto  insure  stability. 

Then  the  designer's  task  is  to  provide  for  large  loop  gains  at  low 
frequencies  to  yield  good  performance  properties,  while  insuring  that  the 
crossover  frequency  and  high  frequency  rolloff  characteristics  are  adequate  to 
guarantee  stability  robustness  and  provide  sensor  noise  rejection.  The  above 
analysis  has  assumed  the  loop  broken  at  the  output.  If  uncertainties  are 
assumed  to  occur  at  the  input  to  the  plant,  all  results  are  similar  except  that 
G(s)K(s)  must  be  replaced  by  K(s)G(s).  For  SISO  systems  these  are 
equivalent,  however  for  MIMO  systems  they  are  not. 

Among  the  various  methods  available  for  design  for  robust  controllers, 
the  linear  quadratic  Gaussian  with  Loop  transfer  recovery  (LQG/LTR) 
methodology  has  many  advantages.  This  methodology  has  been  used  to 
design  controllers  for  turret-gun  systems.  A  brief  description  of  LQG/LTR 
method  is  given  below: 

(E)  LQG/LTR  Design  Methodology 

Doyle  and  Stein  [1]  have  introduced  the  LQG/LTR  controller 
methodology  and  it  has  become  one  of  the  popular  controllers  for  multivariable 
systems.  The  LQG/LTR  design  methodology  seeks  to  define  a  compensator  so 
that  the  stability  robustness  and  performance  specifications  are  met  to  the 
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extent  possible.  A  well  known  property  of  linear  quadratic  regulators  is  that 
they  exhibit  the  following  guaranteed  stability  margins: 


Gain  Margin 


<  oo 


-60°  <  Phase  Margin  <  60° 


...(58) 

...m 


However  no  stability  margin  guarantees  apply  when  the  linear  quadratic 
regulator  and  Kalman  filter  are  combined  into  a  LQG  controller  system.  This  is 
the  motivation  behind  the  loop  transfer  recovery  procedure  of  the  LQG/LTR 
methodology. 

The  LQG/LTR  design  procedure  involves  two  steps.  In  the  first  step  a 
target  feedback  loop  is  selected  which  meet  the  performance  specifications.  In 
the  second  step  the  tunable  parameters  of  the  LQG  controller  are  adjusted  so 
that  the  performance  of  the  feedback  system  approximates  the  performance  of 
the  target  feedback  loop.  The  LQG/LTR  design  procedure  can  be  classified 
into  two  categories.  If  the  modelling  uncertainties  is  reflected  to  the  output 
(input)  of  the  plant,  a  full  state  Kalman  filter  (linear  quadratic  regulator)  is 
designed  to  meet  performance  specifications  and  loop  transfer  recovery  is 
accomplished  with  the  linear  quadratic  regulator  (Kalman  filter).  The  procedure 
for  the  system  where  the  uncertainties  are  reflected  at  the  output  is  given 
below: 


Full-State  Kalman  Filter  Design 

Consider  a  system  represented  by 
x  =  Ax(t)  +  Bu(t)  +  r^(t) 

y  =Cx(t)  +  q(t)  ...(60) 

The  basic  result  for  the  Kalman  filter  is  that  the  Kalman  filter  loop  transfer  matrix 
Tkf(s)  =  C(sl- A)_1Kf  ...(61) 

satisfies  the  following  Kalman  Equality  [15],  [16], 
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I  +  Rj/2C(-jcol  -  A)_1Kf  Rf1/2]H[l  +  Rf1/2  C(jcol  -  A)-1Kf  Rf 1/2 
=  I  +  R^1/2C(-jcol  -  AT)-1Qf(jol  -  A)_1Ct  Rf 1/2 


...(62) 

where  Rf  and  Qf  are  the  control  and  the  states  weighting  matrices.  We  note 
that  the  above  equation  is  the  dual  of  the  LQR.  Let  us  assume 

Rf  =  ixl 
and 

Qf  =  rQ0rT 

where  Qo  =  I  for  simplicity.  Then  equation  (62)  will  be  written  as 

1  H 

[I  +  TKF(i<o)]H[l  +  TKF(ja>)]  =  l  +  — |C(jo)l-  A)'V  C(j<ol -  Af  V  .. .(65) 

M' 

The  singular  value  of  [I+TkfGcd)]  are  given  by  [15] 

ai[l  +  TKF(jcc)]  =  Jl  +  — <jp[C(jo>l  -  A)-'r]  ...(66) 

This  expression  governs  the  performance  and  stability  robustness  properties  of 
KF  loops  [15].  The  matrix  process  noise  T  and  the  positive  scalar  p  are  the 
tunable  parameters.  Therefore,  the  parameters  p  and  r  are  chosen  to  meet 
performance,  crossover,  and  robustness  properties.  It  is  known  that  the  matrix 
T  affects  the  shape  of  the  TFL  singular  values  plots  while  p  simply  raises  or 
lowers  the  plots. 

a.  Performance  Properties.  Good  performance,  requires  high  loop  gains 
at  low  frequencies  and  satisfies  the  equation 

g[TKF(jco)]»1  ...(67) 

For  systems  with  g[TKF(joo)] »  T  the  Equation  (66)  becomes 


...(63) 

...(64) 


27 


"ir0i 

Thus  T  and  \x  are  chosen  to  meet  the  low  frequency  performance  requirements. 
It  is  important  to  notice  that  instead  of  solving  the  ARE  for  the  Kalman  filter  gain 
Kf  to  find  Tkf(s)  of  Equation  (61),  it  is  easier  to  have  different  choices  of  F  and  p 
so  Equation  (68)  can  be  satisfied.  Also,  r  may  be  chosen  to  bring  s[Tkf(s)]  and 
ct[Tkf(s)]  closer  together,  which  typically  produces  a  better  design. 

b.  Crossover  Properties.  From  Equation  (66),  it  is  obvious  that  the  KF 
return  difference  matrix  always  exceeds  unity,  i.e., 

cr[l  -+-  Tkf(JCo)]  >  1  Vco  ...(69) 

which  implies  that 

g[|  +  T^(jo))]>|  Vco  ...(70) 

At  crossover,  it  is  desirable  to  bring  the  minimum  and  maximum  singular  values 
plots  of  Tkf  closer  together. 


C(jcol- A)_1I 


...(68) 


c.  Robustness  Properties.  The  relationship,  o|gK(I  +  GK)~ 
euqivalent  to 


ImM  ’ 


I  +  (G(jco)K(jco))  1  >1m(co) 


...(71) 


The  objective  is  to  approximate  the  open-loop  transfer  matrix  G(jco)K(jco) 
with  T«F(jco).  Hence,  Equations  (70)  and  (71)  have  the  same  form.  Therefore, 
KF  loops  are  guaranteed  to  remain  stable  for  all  unstructured  uncertainties 

reflected  to  the  output  of  the  plant  which  satisfy  1m(«)  <  This  guarantee  will 

cover  the  typical  low  frequency  uncertainties,  but  we  have  seen  that  1m(co) 
usually  grows  greater  than  unity  at  high  frequencies.  Thus,  it  is  necessary  to 
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directly  manipulate  the  high  frequency  behavior  of  TkfO10)-  this  behavior  can 
be  derived  from  known  asymptotic  properties  of  the  regulator  as  the  scalar  p 
tends  to  zero  [1 5],  [16].  The  result  needed  here  is  that  under  minimum  phase 
assumption  on  C^sl-A)-1!",  the  KF  gains  Kf  behave  asymptotically  as 

VpKf-»Wr  as  p^O  ...(72) 

where  W  is  an  orthogonal  . matrix.  At  high  frequencies,  jo  can  be  represented 
jc 

as  s  =  -4=.  as  p  0  with  c  constant.  Therefore, 

VF 


wcr 

— > - 


JC 


=  VpC(jcl-VpA)  Vf 

as  p  — >  0. 


...(73) 


Crossovers  occur  at  aj[TKF(jco)]  =  1,  this  means  that  the  maximum  crossover 
frequency  of  the  loop  should  be 


max 


s[cr] 

'  VS 


...(74) 


This  frequency  cannot  be  much  beyond  the  frequency  where  the  output 
multiplicative  uncertainties  1m(co)=1.  Therefore,  choices  of  r  and  p  that  satisfy 
the  performance  requirement  (68)  must  all  satisfy 

wc  max  —  W1  ...(75) 

where  coi  is  defined  as  the  frequency  where  1m(a)i)=1.  Hence,  the  choices  of 
T  and  p  to  achieve  performance  objectives  via  (68)  are  constrained  by  the 
stability  robustness  requirement  via  (74). 

Loop  Transfer  Recovery  using  LQR.  After  designing  the  full-state 
Kalman  filter  loop  to  have  good  performance,  crossover,  and  robustness 
properties,  we  need  to  add  a  regulator  into  the  system  to  recover  the 
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guaranteed  stability  margins.  This  recovery  procedure  requires  that  the  plant 
transfer  matrix  G(s)  and  the  target  feedback  loop  Tkf(s)  should  be  square  and 
the  plant  G(s)  should  be  minimum  phase. 

The  goal  here  is  to  find  a  procedure  to  recover  guaranteed  margins  by 
selecting  proper  LQR  gains.  Banda  and  Ridgely  [15]  have  presented  a 
detailed  description  of  the  procedure.  The  important  results  are  discussed  in 
this  section.  It  is  desirable  to  choose  the  LQR  gains  KCl  so  that  the  loop 
properties  will  be  the  same  for  the  full-state  and  regulator-based  feedback 
cases.  The  feedback  gain  matrix  Kc  can  be  expressed  as  a  function  of  a  scalar 
parameter  q  such  that 


—  WC  as  q-^» 

q 


...(76) 


where  W  is  any  nonsingular  matrix.  The  LQR  gains  are  given  by 

Kc(q)  =  R“1BTP(q)  ...(77) 

where  P(q)  is  the  solution  of  algebraic  Riccati  equation 

ATp(q)  +  P(q)A  -  P(q)BR“1BT  P(q)  +  Qc(q)  =  0  . .  .(78) 

and  Qc(q)  is  expressed  as  a  function  of  q.  Now  we  redefine  the  LQR  state 
weighting  matrices  as 

Qc  =  HTH  +  q2CTC  ...(79) 

The  term  q2CTC  can  be  thought  of  as  additional  fictitious  state  noise  injected 
into  the  system  through  the  outputs  to  the  plant.  When  q  =  0  the  standard  LQR 
is  obtained.  However,  as  q  is  made  larger  the  loop  properties  become  closer 
and  closer  to  that  of  the  TFL.  Since  the  state  weighting  matrices  become 
increasingly  different  from  the  original  ones,  then  a  tradeoff  between  loop 
recovery  and  accuracy  of  the  LQR  is  necessary. 

Substituting  the  weighting  Equations  (79)  into  the  regulator  ARE  (78),  we 
get 
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At  P(q)  +  P(q)A  +  HT  H  +  q2CTC  - -P(q)BBT  P(q)  =  0 

P 

atP(S)  +  Ma  +  h^+ctc-VMbbtM  =  0 

P  V 


...(80) 

...(81) 


By  assuming  that  C(si-A)'1B  is  minimum  phase  and  the  system  has  as  many 
inputs  as  many  outputs  we  get, 


P(q) 


as  q  — >  oo 


...(82) 


As  a  result  when  q  oo  we  get 


.P(q) 


BRr1Ri1BT 


P(q) 


c  c 


CTC 


...(83) 


and  then 


Kj(q)RcKc(q)_4CTc 

q  q 


as  q-^oo 


If  we  define  W  as 


...(84) 


W  =  R-1/2 


...(85) 


we  will  get 


!5cM^wC  q^~  ...(86) 

q 

This  equation  is  identical  to  Equation  (76).  Hence,  choosing  the  regulator 
weights  as  in  (79)  yields  regulator  gains,  that  give  same  loop  properties  in  the 
limiting  case  as  q  -> 


Alternatively  the  recovery  procedure  can  be  thought  as  a  way  to 
approximate  the  open  loop  transfer  matrix  G(s)K(s)  by  the  TFL  transfer  matrix 
Tkf(s).  As  q2  — »  °o  t  we  have 
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G(s)K(s)  =  COBKc[cI>-i  +  BKc  +  KfC]  Vf 
->  COB[(COB)_1CcDKf  =  CO>Kf 


...(87) 


where  O  =  (sl-A)'1.  This  equation  shows  explicitly  that  the  recovery  inverts  the 
plant  transfer  matrix  from  the  right  and  the  cancellation  of  the  transmission  zeros 
by  their  inverses.  Hence  the  plant  must  be  minimum  phase. 

VIII  FREQUENCY  SHAPED  LINEAR  QUADRATIC  REGULATOR 

In  order  to  place  an  increased  cost  on  the  output  of  a  dynamical  system 
over  a  specified  frequency  range,  a  modification  to  the  standard  linear 
quadratic  regulator  cost  functional  is  required.  The  concept  of  a  frequency¬ 
shaped  linear  quadratic  regulator  (FSLQR)  was  first  introduced  by  Gupta  [2] 
and  has  received  considerable  attention  in  the  literature  [3-6].  The  frequency 
shaped  weighting  elements  on  states  and  inputs  in  the  cost  functional  can  be 
treated  as  compensation  networks  similar  to  those  used  in  classical  control. 

Consider  a  linear  system  represented  by 

x  =  Ax  +  Bu  ...(88) 

with  performance  index 

J  =  ^j^f{xTAx  +  utRu}  dt  ...(89) 

To  understand  the  concept  of  frequency  shaping  it  is  necessary  to  write 
Eq  (89)  in  the  frequency  domain. 

J  =  lj°^{X'(jco)QX(ja))  +  U*(jo))RU(jo))}  do  ...(90) 

where  *  implies  complex  conjugate.  Representation  of  the  cost  functional  in 
frequency  domain  provides  a  procedure  to  the  use  of  frequency  shaping  ideas 
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in  the  multivariable  techniques.  The  generalized  cost  functional  can  be  written 
as 

J  =  {X‘(j£o)Q(jco)X(j(o)  +  U*(ja))R(jco)U(j£o)}  dec  ...(91) 

where  Q(jco)  and  R(jco)  are  Hermitian  matrices  at  ail  frequencies.  A  unique  and 
stable  solution  that  minimizes  the  cost  functional  (91)  exists  when  the  following 
conditions  are  met: 

(i)  The  pair  {A,B}  is  controllable. 

(ii)  The  state  weighting  matrix  Q(jco)  is  symmetric  and  positive 
semidefinite. 

(iii)  The  control  input  weighting  matrix  R(jco)  is  symmetric  and  positive 


definite. 

The  frequency  shaped  cost  functional  (92)  can  also  be  written  as 

J  =  (2^)1  f  {X*(i0))Q(0)2)X(j°)) +  U‘(jw)R(a)2)U(jto)}  dco  . .  .(92) 

To  develop  a  control  design  procedure,  let 

Q(jco)  =  R,*  ( jco)Pi(jco)  •••(93) 

R(j(o)  =  ...(94) 

Define 

X^jco)  =  P,(jo))X(jaj)  ...(95) 

Ui(jas)  =  P2(jco)U(ja>)  ...(96) 

Then  the  performance  index  (92)  is  represented  by 

J  =  J(T{Xi(-ico)Xl(jco) +  ui(ja))ui(ja))}  do)  •  •  -(97) 


Equation  (95)  may  be  expressed  in  terms  of  a  differential  equation  or  state 
variable  form  by  assuming  the  number  of  zeros  in  Pi  (jeo)  does  not  exceed  the 
number  of  poles.  Let  the  state  variable  representation  of  (95)  be  given  by 
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Xi(s)  =  Pi(s)X(s)  ...(98) 

zi  =  Aizi  +  Bix  ...(99) 

xi  =  C-jz-j  ...(100) 

Similarly  Eq  (96)  in  terms  of  the  state  variable  equation  can  be  expressed  as 

Ui(s)  =  P2(s)U(s)  ...(101) 

z2  =  A2Z2  +  B2u  ...(102) 

Ui  =  C2z2  +  D2u  ...(103) 


The  augmentation  of  Eqns  (88),  (99)  and  (101)  yields 
'xl  A  0  Ojxl  f  B ' 

zi  =  Bi  Ai  0  z-i  +  0  u  ...(104) 

z2  0  0  A2  z2  B2 

xe  =  Ae  xe  +  BeU  ...(105) 

The  time  domain  version  for  the  frequency  shaped  cost  functional  can 

be  expressed  as 

J  =  2  Jo  {xi’xi  +  ul’ui}  dt  -.(106) 

Substitution  of  Eqns  (100),  (103)  in  (106)  and  simplification  yields 
J  =  ^Io{XeQexe  +  uTReuT  +  2xjQxuu}  dt 

"o  o  o  ]  r  ° 

where  06=0  010!  0  ;  Re  =  DjD2 ;  Qxu  =  0 

_0  0  CjC2J  CjD2 

By  using  the  standard  linear  quadratic  regulator  results  for  system  (105),  with 
performance  index  (107),  we  obtain 


...(107) 

...(108) 
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u  =  -Kexe  =  -Kcx  -  K1z1  -  K2Z2 


...(109) 


A  block  diagram  representation  of  closed  loop  FSLQR  system  is  shown  in  Fig. 
8. 


Fig.  8  Block  diagram  representation  of  FSLQR  closed  Loop  System. 
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(A)  Disturbance  Attenuation  bv  FSLQR 

The  effect  of  disturbances  can  be  reduced  by  designing  a  controller  so 
that  the  sensitivity  function  of  the  resultant  feedback  control  system  is  small 
over  the  frequency  range  where  the  Dower  spectrum  of  disturbance  is  large. 
Imai  et.  al  [3]  have  developed  a  procedure  for  disturbance  attenuation  by 
adjusting  the  frequency-dependent  weighting  matrices  of  the  FSLQR  method. 

Consider  a  feedback  control  system  shown  below: 


Fig  9.  Closed  Loop  System  with  Disturbances 


G(s)  =  C(sl- A)_1B  ...(110) 

U(s)  =  -K(s)x(s)  ...(111) 

The  general  form  of  the  Kalman  equality  for  the  LQR  is 

[l  +  KcG(jco)]  Rc[l  +  KcG(jo))]  =  Rc  +  G*(jo))QcG(ja))  ...(112) 

The  Kalman  equality  for  FSLQR  is  given  by  [17] 

[l  +  K(jco)G(jco)j*Re[l  +  K(jco)G(jco)]  =  Re  +  G*(jco)Q(co2)G(jco)  ...(11 3) 

Let  Re  =  pi 
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Then  the  Kalman  equality  reduces 


[I  +  K(jo))G(jco)]*[l  +  K(ja))G(jco)]  =  I  +  l[G*(jco)Q(a)2)G(jto)]  ...(114) 

The  minimum  singular  value  of  Eq  (114)  can  be  written  as 

o2[  I  +  K(  jco)G(jco)]  =  1  +  1  Xmin[Q(co2)]g2[G(  jco)]  ...  (1 1 5) 

To  minimize  the  effect  of  disturbances,  it  is  desirable  to  have 

g2[l  +  K(jco)G(jco)]  =  I  +  lxmjn[Q(o)2)]g2[G(]co)]  >  p(co2)  ...(116) 

where  |i(co2)  is  a  low  order  approximation  of  the  power  spectral  density. 

Fora  minimum  phase  system  Eq(16)  is  equivalent  to 

0((o2)  =  p[G(jco)G*(ja))]_1[p.((o2)-  ■)]  ...(117) 

(B)  Robustness  Enhancement  of  FSLQR  Method 

The  major  deficiency  of  the  LQR  methodology  is  the  underlying 
assumption  that  the  model  is  accurate  for  all  frequencies.  In  most  cases, 
however,  the  design  model  is  a  low  frequency  approximation  and  is  not 
accurate  at  high  frequencies.  Anderson  and  Mingori  [4]  have  developed  a 
FSLQR  methodology  to  enhance  the  robustness  of  models  with  high  frequency 
uncertainty.  They  showed  that  stability  robustness  can  be  enhanced  if  a  lead 
filter  is  used  in  the  diagonal  elements  of  R(jco).  For  simplicity,  their  development 
is  described  in  this  section  for  SIMO  (single-input-multi-output)  system.  The 
results  can  be  extended  to  include  the  MIMO  case. 

A  SIMO  system  S  is  described  by 

S:  x  =  Ax  +  bu,  y  =  Cx  ...(118) 
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where  x  is  an  nxl  state  vector,  u  is  the  control  input,  y  is  an  rxl  output  vector 
and  {A,  b,  C}  are  of  appropriate  dimensions.  The  desired  cost  functional  is  of 
the  form 


J  =  1  /  (2jt)J~[X*(jto)QcX(jG))  +  R(co2)U2(jo))]  dco  ...(119) 

where  Qc  =  CTC  and 

R(jco)  =  -I—!———,  (3  >  a  >  0  ...(120) 

jooa  + 1 

A  stable  solution  is  guaranteed  if  Qc  is  positive  semidefinite,  {A,  b}  is 
stabilizable,  and  {A,  C}  is  detectable.  The  state  space  descriptions  of  Qc  and 
R(jw)  are: 

z  =  0  ...(121) 

xi  =  CTCx  ...(122) 

Z2  = -a_1Z2  +  pa-iu  ...(123) 

U2  =  (P~1-a~1)Z2  +  Pa-1u  ...(124) 

The  resulting  time  domain  cost  functional  is 

J  =  j0>lTxi  +  u22]dt  ...(125) 

In  order  to  make  the  robustness  effect  more  visible,  Anderson  and  Mingori  [4] 
redefined  the  input  of  Eqns  (1 23  and  1 24)  as  U2-  Solving  for  Eqns  (123  and 
124)  for  u,  yields 

z2  =  -p-1Z2  +  U2  ...(126) 

u  =  (p-1-ap-2)z2  +  ap-1U2  ...(127) 

The  redefined  state  equation  for  the  input  filter  results  in  the  new  cost  functional 
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...(128) 


J  =  Jo°°[x1Tx1  +  u2]  dt 

Applying  the  FSLQR  procedure  results  in  the  following  optimal  control  law 

U2  =  kcx  +  k2Z2  ...(129) 

Taking  the  fourier  transform  of  Equation  (126),  solving  for  Z2(ja>),  and  then 
substituting  into  the  Fourier  transform  of  Equation  (129)  yields 

Ua(jco)  =  .-&  +  Ipt-  kcX(jm)  ...(130) 

J(0  +  p_1-k2 

Solving  the  original  problem  of  U(jco)  results  in  the  controller  transfer  function 
K(jco): 


u(iM) “ ‘  i^-pk2)kcX(jm) "  K(i“)X(i“>  -(1 31) 

Anderson  and  Mingori  [4]  derived  low  frequency  inequalities  for  the  frequency¬ 
shaped  design  presented  here  and  also  for  the  conventional  LQR  problem. 
These  inequalities  are: 


|1  +  K(jo)G(ja>)|2> 


joip  +  l 

jco(3  +  (1-(3k2) 


|1  +  Kc(ja))G(ja>)|2>  1  (LQR) 


(FSLQR) 


...(132) 

...(133) 


It  was  proven  in  Reference  [4]  that  k2  is  less  than  zero,  then  at  low  frequencies 
the  FSLQR  system  will  loose  some  robustness  due  to  the  frequency  shaping  of 
the  input  when  compared  to  the  LQR  system.  The  amount  of  performance 
robustness  lost  due  to  frequency-shaping  is  approximately  (1-(3k2 )'2.  For  high 
frequencies,  the  following  approximations  exist 

|K(joa)G(jco)|=  -kcba(3-2o)-1  (FSLQR)  ...(134) 

|KcG(jto)|=  bTPbo)_1  (LQR)  ...(135) 
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Since  k2  is  negative,  a  third  inequality  applicable  for  high  frequencies  can  be 
defined  as  follows: 

|K(jo>)G(jo))|<|KcG(jco)|  ...(136) 

Inequality  (136)  states  that  stability  robustness  is  improved  when  frequency 
shaping  of  the  input  is  employed  in  the  form  of  a  lead  filter.  In  fact,  if  a  =  0,  then 
the  high  frequency  slope  of  K(jco)G(jco)  falls  at  a  rate  of  -40dB/decade. 

ix_Fa.LQR-yy.iiH  output.  eeeqback  meth..qdqlqgy. 

The  implementation  of  the  frequency  shaped  linear  quadratic  regulator 
(FSLQR)  requires  the  availability  of  states  for  feedback.  This  requirement  is 
met  by  designing  an  appropriate  state  estimator.  The  use  of  an  estimator 
increases  the  order  of  the  controller.  The  order  of  the  controller  may  be  even 
greater  if  integrators  are  included  for  command  following.  To  alleviate  this 
problem  a  FSLQR  design  methodology  using  output  feedback  is  presented 
below.  Levine  and  Athans  [18]  and  Moerder  and  Calise  [19]  have  developed 
procedures  for  determination  of  the  optimal  constant  feedback  controllers  for 
multivariable  systems.  In  the  proposed  method,  the  concepts  of  output 
feedback  and  frequency  shaping  are  incorporated  in  the  design  of  controllers. 

The  salient  features  of  the  proposed  methodology  are  given  below: 

(i)  Frequency-shaped  weighting  matrices  are  considered  in  the  cost 
functional. 

(ii)  The  linear  quadratic  regulator  with  output  feedback  design 
methodology  is  employed. 

(iii)  The  proposed  methodology  may  result  in  lower  order  controllers 
compared  to  LQG/LTR  methodology  (Dependent  on  the 
complexity  of  Q(jco)  and  R(joo)). 

A  brief  review  of  the  linear  quadratic  regulator  with  output  feedback 
procedure  is  given  below: 
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Consider  a  system  represented  by 


...(137) 

...(138) 


x  =  Ax  +  Bu 
y  =  Cx 

with  C  of  full  rank  and  the  performance  index 

J  =  JQ  jxTQx  +  uTRu}  dt  ...(139) 

where  Q  >  0,  R  >  0.  It  is  desired  to  minimize  J  by  applying  output  feedback  of 
the  form 


u  =  -Ky  ...(140) 

When  this  optimal  control  problem  has  a  solution,  the  feedback  gain  matrix  is 
given  by 


K  =  R-iBTSPCT(CPCT)-1  ...(141) 

Define  A*  =  A-BKC  ...(142) 

The  matrices  S  and  P  are  the  solutions  of  the  following  algebraic  equations: 

A*TS  +  SA*  +  Q  +  CTKTRKC=0  ...(143) 

A*P  +  PA*t  +  I  =0  ...(144) 


A  numerical  algorithm  for  solving  Eqns  (161-166)  is  given  [19],  By  combining 
the  standard  FSLQR  results  (Section  VIII)  with  output  feedback  LQR,  we  have 
obtained  an  FSLQR  with  output  feedback  design  methodology  and  is  given 
below: 


From  Eqns  (105)  and  (107),  the  FSLQR  procedure  is  to  minimize 


J  =  ^Jof{XeQxe  +  uTReUT  +  2xTQxuu}dt 


...(145) 
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subject  to 


xe  =  Aexe  +  Beu  ...(146) 

y  =  CeXe  ...(147) 

It  is  desired  to  minimize  J  by  applying  output  feedback  of  the  form 

u  =  -Key  ...(148) 


The  optimization  solution  for 


—  =  0  ...(149) 

3Ke 

is  given  by 

Ke  =  Ri'BjSe  PeCj(Ce  PeCj)"'  ...(150) 

where 

A*  =  Ae-BeKeCe  ...(151) 

Se  A*  +  A*TSe  +  Qe  +  Cj  K  J  Re  KeCe  =  0  ...(152) 

A;Pe  +  PeA;T  +  l  =  0  ..-(153) 


Moerder  and  Calise  [19]  proved  that  the  gain  algorithm  (Eqns  150-153) 
converges  to  a  local  minimum  under  the  following  conditions: 

(i)  The  pair  {Ce,Ae}  is  detectable 

(ii)  The  matrix  Re  is  positive  definite 

(iii)  Full  row  rank  for  C. 

Mariton  and  Bertrand  [20]  have  introduced  a  modification  to  numerical 
algorithm  [19]  for  solving  Eqns  (150-153),  by  comparing  the  cost  of  the  i” 
iteration  J(i)  with  optimal  cost  J(opt).  This  comparison  is  accomplished  by 
defining  an  optimality  factor 
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...(154) 


V(i)  = 


J(i)  ~  J(opt) 
J(opt) 


where  J(i)  =  Tr.  [S(i)] 

J(opt)  =  The  cost  associated  with  full  state  feedback 

(A)  Performance  Robustness  Design  Guidelines 

Performance  robustness  is  a  measure  of  how  well  a  control  system 
tolerates  parameter  variations,  external  disturbances,  and  steady  state  errors. 
To  achieve  good  performance  robustness,  the  singular  values  of  the  loop 
transfer  function  K(jco)CG(jco)  must  be  greater  than  1  at  low  frequencies.  Also, 
to  achieve  integral  control  (i.e.  command  following),  the  slope  of  the  singular 
value  plots  must  be  at  least  -20dB/decade  at  low  frequencies. 

In  LQR  low  frequency  design,  the  following  approximation  exists 

<j,[KcG(jco)]  =  1  /  Vpoi[HG(jco)]  ...(1 55) 

where  Qc  =  HTH.  A  similar  low  frequency  approximation  exists  for  the  full  state 
feedback  FSLQR.  Rewriting  the  Kalman  equality  as: 

[I  +  K(jco)G(jco)]*Re[l  +  K(jo))G(jo))]  =  Re  +  G*(ja))Q(co2)G(jw)  .  ..(1 56) 


where  K(jco)  is  the  full  state  feedback  version  of  K(jco)  and  if  Re  =  pi,  then  the 
Kalman  equality  reduces  to 

[I  +  K(jci))G(j«)]*[l  +  K(jo))G(j(o)]  =  I  +  p-1G*(jco)Q(a)2)G(jco)  . .  .(1 57) 

The  singular  values  Cj  of  the  above  equation  are: 

Oj2[l  +  K(  jco)G(jo))]  =  Gj[l  +  p-i{Q(ja))Gp(jco)}*Q(jco)G(  jco)]  . .  .(1 58) 

Since  Oj[l+K(ja))G(jG))]»1  at  low  frequencies,  then  a  good  low  frequency  model 
of  the  loop  transfer  function  is 
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Oj[K(jco)G(jo))]  =  1  /  Vp  aj[Q(jco)G(ja>)] 


...(159) 


Modifying  equation  (159)  to  include  the  output  feedback  constraint  yields  the 
low  frequency  approximation 

Oj[K(jo))CG(jco)]  =  1  /  Vp  Oj[{Q(j(o)C  +  H}G(ja>)]  . . .(1 60) 

where  R(jco)  =  pi. 

(B)  Loop  Shaping  Procedure 

The  loop  shaping  procedure  for  this  problem  is  the  same  as  the  LQR  low 
frequency  design  outlined  by  Doyle  and  Stein  [1],  Briefly,  the  amin  and  amax 
plots  of  the  loop  transfer  function  given  in  Equation  (160)  should  be  as  close 
together  as  possible,  especially  at  the  crossover.  The  shape  of  the  plots  may 
be  altered  by  changing  Q(jco)  and  H.  The  dc  gain  of  the  plot  can  be  adjusted 
for  proper  0  dB  crossing  by  tuning  the  scalar  p.  The  maximum  crossover 
frequency  cocmax  should  be  less  than  the  crossover  frequency  co^  of  the 
uncertainty  scalar  Lm(co).  The  uncertainty  scalar  represents  the  maximum 
multiplicative  uncertainty  in  the  plant  G(jco).  A  list  of  typical  frequency  shaped 
weighting  elements  for  Q(r)  and  R(s)  are  given  in  Tables  lll-IV. 
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TABLE  III 

FREQUENCY-SHAPED  WEIGHTING  ELEMENTS  FOR  Q(s) 


Qij(s) 

Application 

Sii 

s 

integrator  for  command  following  and 
elimination  of  sensor  biases 

1  +  TS 

■  qii  s 

proportional-integral  control 

ts 

q,|l  +  ts 

"wash-out"  filter  to  eliminate  steady-state 
feedbacks  or  to  approximate  the  derivative 
function  for  use  in  PID  controllers 

..  1  +  xis 

C'iH  +  t2S 

provide  cross-coupling  phase  lead  to 
decrease  gain  scheduling  points  (xl  >t2) 

qij«a 

S  +  wa 

low  pass  filter  to  attenuate  high  frequency 
noise 

s2  +  (oa 

s2  +  2^coas  +  coa^ 

notch  filter  to  eliminate  bending  mode 
feedback 
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TABLE  IV 

FREQUENCY-SHAPED  WEIGHTING  ELEMENTS  FOR  R(s) 


Rij(s) 

Application 

p(1+  S/(O0)n 

for  models  with  high  frequency  uncertainty 
(n  =  1 , 2,  .  .  .  ) 

p(1  +  s/coo) 

(1  +  s/coi) 

for  models  with  high  frequency  uncertainty 
(0)0  <  0)1 ) 

P(1  +  s2/gdo2) 

(1  +  2^S  /  €00  +  S2  /  COO2) 

eliminate  control  response  at  coo 

X  DESIGN  OF  REDUCED  ORDER  ROBUST  CONTROLLERS 


In  order  to  minimize  the  computational  and  implementation  of  LQG/LTR 
methodology,  the  reduced  order  models  are  used  for  design  of  controllers.  The 
reduced  order  models  derived  by  using  balance-truncation,  Litz’s  modal  and 
Routh  Approximation  methods  gave  identical  frequency  responses  in  the  range 
of  0.01  to  1000  rad/sec.  The  reduced  order  model  derived  by  using  the 
balance-truncation  method  is  used  to  design  reduced  order  LQG/LTR 
controllers. 

Let  K(s)  and  Kr(s)  represent  the  transfer  functions  of  LQG/LTR  controllers 
designed  using  the  original  12th  order  system  and  7th  order  reduced  model 
respectively. (Figs.  10  and  1 1)  The  singular  value  plots  of  the  target  feedback 
loop  and  open  loop  transfer  functions  G(s)  K(s)  and  G(s)  Kr(s)  are  shown  in  Fig 
(12).  The  eigenvalues  of  the  closed  loop  systems  full  and  reduced  order 
controllers  are  given  in  Table  V.  From  the  eigenvalues  of  the  closed  loop 
system,  it  is  evident  that  the  spillover  problem  is  not  present  in  this  system. 
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Fig  10.  Implementation  of  Full  order  Controller. 


Fig  11.  Implementation  of  Reduced  Order  Controller. 
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Table  V 

Eigenvalue  Comparisons  of  Closed  Loop  System 


12th  Order  System 

12th  Order  Controller 

12th  Order  System 

7th  Order  Controller 

-54.056 

-7.6669 

-13.177  ±j63.377 

-3.4081  ±j82.891 

-21.011  ±  jl 38.87 

-75.8  ±  J57.122 

-21.487  ±  j295.08 

-16.448  ±  jl  40.42 

-945.26 

-15.721  ±  j  1 73. 1 8 

-1573.2  ±j4550. 7 

-62.465  ±  j307.78 

-122.23  ±  J6397.9 

-550.88 

-0.9278 

-320.9  ±  J759.85 

-2.999  ±j1 69.96 

-1522.2 

-217.35  ±j1 72.77 

-1572.9  ±j4550.6 

-2258  ±  j4380 

-122.24  ±j6397.8 

-8098.5 

-5984.6  ±j631 0.4 

-963.16  ±  19854.0 

The  phase  and  gain  margins  of  the  target  feedback  loop,  closed  lop 
systems  with  original  and  reduced  order  controllers  are  given  in  Table  VI. 

TABLE  VI 


Gp  Pp 


Target  feedback  loop  <*>  69° 

Closed  loop  system  with  original  controller  22  dB  64° 

Closed  loop  system  with  reduced  order  controller  13  dB  61° 
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Simulation  Results 


The  parameters  of  the  system  matrix  are  perturbed  by  5%  and  the  step 
responses  for  full  order  design  and  reduced  order  design  are  plotted  in  Fig 
(13).  For  the  same  perturbation,  the  ramp  responses  were  plotted  in  Fig  (14). 
Figure  (15)  contains  the  step  responses  with  random  disturbances  at  the 
output. 
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rull  order  design  (with  nominal  plant) 

Full  order  design  (5%  perturbation) 
Reduced  order  design  (with  nominal  plant) 
Reduced  order  design  (5%  perturbation) 


UOIJjSOd 
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Fig  13.  Step  Response  Comparisons 


Response  Comparison 
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Fig  15.  Step  Response  with  Disturbances 


XI  CONCLUSiONS 


A  procedure  for  the  design  of  robust  controllers  for  a  Turret-Gun  system 
mounted  on  helicopters  is  presented  in  this  research  report.  The  robust  control 
strategies  will  guarantees  stability  and  provide  satisfactory  performance  in  the 
presence  of  model  uncertainties.  The  linear  quadratic  Gaussian  with  loop 
transfer  recovery  (LQG/LTR)  and  frequency  shaped  linear  quadratic  regulator 
(FSLQR)  with  output  feedback,  design  methodologies  have  been  employed  to 
design  robust  controllers.  A  description  of  these  design  procedures  is  included 
in  the  report.  The  FSLQR  with  output  feedback  is  a  relatively  new  approach 
and  is  suitable  for  a  turret-gun  system. 

In  order  to  provide  simplicity  of  implementation  and  reduction  control 
hardware  requirements,  a  simpler  model  for  the  turret-gun  system  is 
investigated.  Reduced  order  models  are  derived  by  using  balance-truncation, 
Routh  approximation  and  model  techniques.  The  eigenvalues  and  time 
responses  of  reduced  order  models  are  compared  with  the  original  system.  It  is 
very  hard  to  see  the  difference  between  step  responses  of  original  and 
reduced  order  models.  There  is  an  excellent  low  frequency  match  between 
original  and  reduced  order  models. 

The  balanced  reduced  order  models  are  employed  to  design  LQG/LTR 
controllers.  The  eigenvalues  and  stability  margins  of  the  reduced  order  design 
are  compared  with  the  original  high  order  controller.  These  comparisons  and 
simulation  results  indicate  that  the  reduced  order  design  gave  satisfactory 
results.  The  spillover  problems  are  not  present  in  this  closed  loop  system. 

The  practical  implementation  of  robust  controllers  on  the  gun  system  is 
an  interesting  and  challenging  job.  It  is  recommended  that  the  robust 
controllers  be  implemented  and  compare  the  response  of  the  open  loop  and 
closed  loop  system  for  the  effects  of  parameter  variations,  unmodelled 
dynamics,  sensor  and  system  noises. 
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